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Risk classification for vascular com- 
plications is of particular impor- 
tance in diabetes care, and there is 

a need for validated diabetes-specific risk 
engines (1,2). Asian populations account 
for >60% of the world's diabetes patients 
(3,4), but data used for most of the en- 
gines specific to diabetes include only a 
limited number of Asians (5-9). Asian pa- 
tients with diabetes have several impor- 
tant features. We previously reported 
that Japanese patients have a markedly 
low prevalence of obesity and low inci- 
dence rates of overt nephropathy and di- 
abetic retinopathy (10-13). Furthermore, 
the risk factor profiles of diabetes compli- 
cations are quite different between Japa- 
nese and Western subjects with diabetes 
(14). In cohort studies of multiple ethnic 
groups, lower incidence rates of cardio- 
vascular disease (CVD) were observed in 
Asian patients than in whites (15,16). 
Given the overestimation of risks of cor- 
onary heart disease (CHD) and stroke in 
Chinese patients by the UK Prospective 
Diabetes Study (UKPDS) risk engine 
(17,18), risk engines for non-Asian pop- 
ulations may not be transportable to 
Asian patients. To our knowledge, only 
the Hong Kong Diabetes Registry (HKDR) 
has developed risk engines for Asian pa- 
tients with diabetes (17-20). 

Most risk engines have focused on 
classical cardiovascular risk factors such 
as control of HbAi^, blood pressure, and 
lipids (5-9,17-20), but, increasingly, 
studies have suggested the importance 
of lifestyle factors. In fact, exercise has 
been shown to reduce all-cause mortality 
(21,22) and is encouraged by guidelines 
for type 2 diabetes (23,24). A recent sur- 
vey of general practitioners in Germany 
indicated that those physicians thought 
that to be useful, risk engines should 
link estimated risks with appropriate rec- 
ommendations for lifestyle changes (25). 
Another concern is the lack of capacity to 
assess multiple diseases simultaneously 
(25). However, just combining the results 
of risk engines specific to each vascular 
complication may yield biased estimates 



OBJECTIVE — To develop and validate a risk engine that calculates the risks of macro- and 
microvascular complications in type 2 diabetes. 

RESEARCH DESIGN AND METHODS— We analyzed pooled data from two clinical trials 
on 1,748 Japanese type 2 diabetic patients without diabetes complications other than mild diabetic 
retinopathy with a median follow-up of 7.2 years. End points were coronary heart disease (CHD), 
stroke, noncardiovascular mortality, overt nephropathy defined by persistent proteinuria, and pro- 
gression of retinopathy. We fit a multistate Cox regression model to derive an algorithm for pre- 
diction. The predictive accuracy of the calculated 5-year risks was cross-validated. 

RESULTS — Sex, age, HbAie, years after diagnosis, BMI, systolic blood pressure, non-HDL 
cholesterol, albumin-to-creatmine ratio, atrial fibrillation, current smoker, and leisure-time 
physical activity were risk factors for macro- and microvascular complications and were incor- 
porated into the risk engine. The observed-to-predicted (O/P) ratios for each event were between 
0.93 and 1.08, and Hosmer-Lemeshow tests showed no significant deviations between observed 
and predicted events. In contrast, the UK Prospective Diabetes Study (UKPDS) risk engine over- 
estimated CHD risk (O/P ratios: 0.30 for CHD and 0.72 for stroke). C statistics in our Japanese 
patients were high for CHD, noncardiovascular mortality, and overt nephropathy (0.725, 0.696, 
and 0.767) but moderate for stroke and progression of retinopathy (0.636 and 0.614). By 
combining macro- and microvascular risks, the classification of low- and high-risk patients 
was improved by a net reclassification improvement of 5.7% (P = 0.02). 

CONCLUSIONS — The risk engine accurately predicts macro- and microvascular complications 
and would provide helpful information in risk classification and health economic simulations. 
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of absolute risks since it is likely that each 
engine was developed independently, 
and a correlation between incidences of 
vascular complications is not accounted 
for in the development process. 

Data from the 1,748 patients with 
type 2 diabetes in the Japan Diabetes 
Complications Study QDCS) (26) and 
the Japanese Elderly Diabetes Interven- 
tion Trial (J-EDIT) (27) provide an oppor- 
tunity to develop a comprehensive risk 
engine for Asian patients with type 2 di- 
abetes. The aim of the current study was 
therefore to develop and validate an algo- 
rithm that separately calculates each risk 
of the first occurrence for five events: fatal 
and nonfatal CHD, fatal and nonfatal 
stroke, noncardiovascular mortality, 
overt nephropathy, and progression of 
retinopathy. This was done by fitting a 
multistate Cox regression model (28), an 
extension of the Cox model to multiple 
time-to-event end points, to the pooled 
data from these trials. 

RESEARCH DESIGN AND 
METHODS 

Patients and measurements 

Design of the JDCS and the J-EDIT has 
been described in detail elsewhere (26,27). 
In the JDCS, 2,033 Japanese type 2 diabetes 
patients 40-70 years of age whose HbAic 
levels were >7.0% were randomized to a 
conventional treatment group and a life- 
style intervention group; throughout the 
paper, we present the National Glycohe- 
moglobin Standardization Program value 
of HbAic calculated as follows: 0.25 + 
1.02 X JDC value (29). The latter group 
received education on lifestyle modifica- 
tion by telephone counseling and at each 
outpatient clinic visit in addition to usual 
care. The J-EDIT is a randomized, con- 
trolled trial of intensive and conventional 
treatments for diabetes that registered a total 
of 1 , 1 73 Japanese t}'pe 2 diabetes patients 
65-85 years of age whose HbAi^ levels were 
>8.1%, or >7.5% with at least one of the 
following criteria: BMI >:25 kg/m^; blood 
pressure ^130/85 mmHg; serum total 
cholesterol >200 mg/dL (5.17 mmol/L) 
or LDL cholesterol >120 mg/dL (3.10 
mmol/L) in participants without CHD; 
serum total cholesterol >180 mg/dL 
(4.65 mmol/L) or LDL cholesterol >100 
mg/dL (2.59 mmol/L) in participants 
with CHD; triglycerides &150 mg/dL 
(1.68 mmol/L); and HDL cholesterol 
<40 mg/dL (1.03 mmol/L). The protocols 
of the JDCS and J-EDIT received approval 
from the ethical committees of all of the 



participating institutes, and written in- 
formed consent was obtained from all pa- 
tients before enrollment. The present 
analysis excluded patients who had any 
history of angina pectoris, myocardial in- 
farction, stroke, peripheral artery disease, 
familial hypercholesterolemia (diagnosed 
clinically by markedly elevated LDL cho- 
lesterol levels with enlarged Achilles ten- 
dons and/or family history of premature 
coronary artery disease), type III hyperlip- 
idemia (diagnosed by broad |5-band on 
electrophoresis), nephrotic syndrome, se- 
rum creatinine levels >1.3 mg/dL (120 
|jLmol/L), mean values of two spot urine 
examinations for an albumin excretion 
rate of 150 mg/g creatinine (17.0 mg/ 
mmol) or more, microscopic hematuria, 
or other clinical findings indicating other 
renal diseases, preproliferative and prolif- 
erative retinopathy, and major ocular dis- 
ease (e.g., glaucoma, dense cataract, or 
history of cataract surgery). Baseline data 
were collected for demographics, results 
of clinical examinations, laboratory mea- 
surements performed at local laboratories, 
and Ufestyle factors such as dietary content 
and smoking status determined by self- 
reported questionnaires. Leisure-time phys- 
ical activity (LTPA) was also assessed at 
baseline by a self-administered question- 
naire, which was almost identical to that 
used and validated in the Health Profes- 
sionals' EoUow-up Study (30). The pa- 
tients were asked to report their average 
frequency (times/week) and duration 
(min/time) of normal walking, brisk walk- 
ing, jogging, golfing, tennis, swimming, 
aerobics dancing, cycling, and other mis- 
cellaneous exercise as specified by each 
patient. The duration engaged in each ac- 
tivity in min/time was multiplied by that 
activity's typical energy expenditure, ex- 
pressed in metabolic equivalents (METs), 
and overall activities were summed to 
yield a MET/h score per week (31). Data 
management was conducted by a central 
data center. EoUow-up data were collected 
through a standardized annual report 
from each investigator. Non-HDL choles- 
terol (NHDL-C) levels were calculated by 
total cholesterol subtracted by HDL cho- 
lesterol. LDL cholesterol levels were calcu- 
lated using the Friedewald formula, that is, 
NHDL-C subtracted by triglycerides di- 
vided by 5 if triglyceride levels are <400 
mg/dL (4.48 mmol/L); otherwise, LDL cho- 
lesterol levels were treated as missing data. 

End points 

End points were five time-to-event 
variables: fatal or nonfatal CHD, fatal 



or nonfatal stroke, noncardiovascular 
mortality, overt nephropathy defined by 
persistent proteinuria, and progression of 
retinopathy since randomization. The def- 
initions of the events have been described 
in detail elsewhere (12,13,27,32). In brief, 
diabetic retinopathy was determined an- 
nually by qualified ophthalmologists at 
each institute using the international dia- 
betic retinopathy and diabetic macular 
edema disease scales (33) with minor 
modification: stage 0, no retinopathy; 
stage 1, hemorrhage and hard exudates; 
stage 2, soft exudates; stage 3, intraretinal 
microvascular abnormalities and venous 
changes, including beading, loop, and du- 
plication; and stage 4, new vessels, vitre- 
ous hemorrhage, fibrous proliferation, 
and retinal detachment. A retinopathy 
event was progression to stage 3 or 4. 
A nephropathy event was defined as the 
development of overt nephropathy (spot 
urinary albumin excretion >33.9 mg/ 
mmol creatinine in two consecutive sam- 
ples) (12). Macrovascular events included 
the occurrence of fatal and nonfatal defi- 
nite CHD (angina pectoris or myocardial 
infarction) and fatal and nonfatal stroke. 
The diagnosis of angina pectoris and myo- 
cardial infarction was according to criteria 
defined by the Multinational Monitoring 
of Trends and Determinants in Cardio- 
vascular Disease project, and diagnosis 
of stroke was according to guidelines de- 
fined by the Ministry of Health, Labour, 
and Welfare of Japan (32). Adjudication 
of end points was performed by central 
committees comprised of experts in each 
complication based on additional data 
such as those obtained by computed to- 
mography or magnetic resonance imag- 
ing of the brain or sequential changes in 
electrocardiograms. 

Statistical analysis 

The JDCS/J-EDIT OJ) risk engine calcu- 
lates each risk of the first occurrence 
within a user-specified time point for 
the five events described above. The 
occurrences of these events are viewed 
as transitions between disease states and 
were modeled by a multistate model that 
follows the Markov renewal process (28). 
The disease states and transitions as- 
sumed in the multistate model are de- 
tailed in Supplementary Data. We fit a 
multistate model using a standard proce- 
dure for the stratified Cox regression 
model. That is, we assumed that baseline 
intensities for any of the transitions were 
possibly different but that transition in- 
tensities to a disease state share common 
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hazard ratios (HRs) for risk factors. The 
following risk factors were screened 
through a backward variable selection 
with the critical value of P = 0.1: age, 
sex, HbAic, years after diagnosis, BMI, sys- 
tolic blood pressure (SBP), NHDL-C, 
LDL cholesterol, HDL cholesterol, log- 
transformed triglycerides, log-transformed 
urine albumin-to-creatinine ratio (ACR), 
estimated glomerular filtration rate, atrial 
fibrillation, smoking status, alcohol in- 
take, and LTPA. BMI was categorized by 
cutoff points of 18.5 and 25 kg/m^. LTPA 
was categorized by the cutoff point of 3.8 
METs-h/week, which corresponds to the 
intensity of home activity or conditioning 
exercise (31). HRs in this model were 
estimated by maximizing the partial 
likelihood, and then baseline intensity 
functions were calculated by the Breslow 
estimator. Missing data were substituted 
using the multiple imputation method. 

We assessed the predictive accuracy of 
the 5 -year risks based on the JJ risk engine 
using 10-fold cross-validation, i.e., we per- 
formed 10 rounds of cross-validation using 
different partitions. One round of cross- 
validation involved randomly partition- 
ing a sample of data on 1 ,748 patients into 
complementary subsets, fitting the strati- 
fied Cox regression model to one subset of 
90% of patients, and validating the model 
on the remaining subset with the criteria 
described below. We compared hazards 



for end points between tertiles of the 
calculated 5-year risks from the 10-fold 
cross-validation by the Cox regression. 
Calibration, namely, how closely the pre- 
diction reflected observed events, was 
assessed for each event by the Hosmer- 
Lemeshow test and the mean of observed- 
to-predicted (0/P) ratios, which was 
calculated as the mean of ratios of the 
observed-to-expected events across the 
strata used in the Hosmer-Lemeshow 
test. Discrimination, the ability to distin- 
guish between those who experienced the 
event and those who did not, was evalu- 
ated using Harrell C statistics, the pro- 
portion of all patient pairs in which the 
predictions of the model and observed 
events were concordant. Further, we con- 
structed a reclassification table of macro- 
and microvascular complications (34). 

AU analyses were conducted by the 
central data center with the use of SAS 
software version 9.2 (SAS Institute, Cary, 
NC). The authors had full access to the 
data and take responsibility for their in- 
tegrity. All reported P values for statistical 
tests are two tailed, and P < 0.05 was 
taken to indicate statistical significance. 

RESULTS— The mean ± SD (range) 
age and HbAic level at baseline of the 

1,748 Japanese type 2 diabetic patients 
was 62.1 ± 8.6 (40-84) years and 7.9 ± 
1.2 (6.0-15.8)%, respectively, and 49.9% 



of the subjects were women. Their mean 
baseline values indicated that the 
subjects had good control of weight 
(BMI = 23.2 ±3.1 kg/m^; waist circum- 
ference = 80.3 ± 9.6 cm), blood pres- 
sure (SBP = 132.9 ± 16.0 mmHg), and 
serum cholesterol levels (NHDL-C = 3.78 
± 0.90 mmoVL; LDL cholesterol = 3.16 ± 
0.82 mmol/L; HDL cholesterol = 1.43 ± 
0.44 mmoR; triglycerides = 1.39 ± 0.88 
mmol/L). Their baseline ACR levels were 
quite low, with a median ± IQR of 1.8 ± 
3.0 mg/mmol, as we excluded those with 
ACR of 17.0 g/mmol or more. Current 
smokers and past smokers accounted for 

24.4 and 24.0%, respectively, of patients. 
The median (IQR) LTPA at baseline was 

10.5 (1.6-22.5) METs-h/week, and 
34.0% of patients had no exercise habit 
(<3.8 METs-h/week). During the median 
follow-up of 7.2 years, among the 1,748 
subjects, we observed 96 (5.5%) events of 
fatal or nonfatal CHD, 89 (5.1%) fatal or 
nonfatal strokes, 71 (4.1%) overt ne- 
phropathies defined by persistent protein- 
uria, and 64 (3.7%) noncardiovascular 
deaths. Of the 1,297 patients without ret- 
inopathy at baseline, 415 (32.0%) devel- 
oped retinopathy. Of the 866 patients who 
had retinopathy or developed retinopathy 
after baseline, 113 (13.0%) had progression 
to retinopathy of stage 3 or 4. 

The backward variable selection pro- 
cedure identified 1 1 baseline risk factors 



Table 1 — HRs of risk factors incorporated in the best-fitting multistate Cox regression model 









CHD 






Stroke 




Noncardiovascular mortality 




HR 


95% CI 


P 


HR 


95% CI 


P 


HR 


95% CI 


P 


Sex (woman/man) 


0.41 


0.24 


0.70 


<0.01 


0.46 


0.29 


0.73 


<0.01 


0.55 


0.29 


1.04 


0.07 


Age (+10 years) 


1.38 


1.02 


1.85 


0.04 


1.55 


1.17 


2.06 


<0.01 


2.44 


1.70 


3.50 


<0.01 


HbAie (+1%) 


1.22 


1.02 


1.45 


0.03 


1.23 


1.04 


1.44 


0.02 


































0.01 


BMI (> 25/18.5-25 kg/m^) 


















1.16 


0.60 


2.21 


0.66 


SBP (+10 mmHg) 


1 1.13 


0.98 


1.31 


0.10 


1.16 


1.00 


1.33 


0.045 










NHDL-C (+1 mmol/L) 


1.56 


1.26 


1.93 


<0.01 


1.38 


1.10 


1.74 


0.01 












Current smoker (yes/no) 


1.67 


1.00 


2.81 


0.052 










2.11 


1.04 


4.26 


0.04 


LTPA (>3.8/<3.8 METs-h/week) 










0.63 


0.39 


1.01 


0.053 


0.57 


0.33 


1.01 


0.054 






Overt nephropathy 




Retinopathy 












Age (+10 years) 










1.16 


1.04 


1.30 


0.01 










HbAi, (+1%) ■ 










1.32 


1.25 


1.40 


<0.01 










Years after diagnosis (+1 years) 










1.04 


1.03 


1.06 


<0.01 










BMI (< 18.5/18.5-25 kg/m^) | 
BMI (>25/18.5-25 kg/m^) 










0.67 


0.43 


1.03 


0.07 B 


















1.22 


0.99 


1.49 


0.06 










Log ACR (+1 unit) 


3.02 


2.16 


4.23 


<0.01 


1.11 


1.01 


1.22 


0.03 










Atrial fibrillation (yes/no) 


_ 5.54 


0.74 


41.49 


0.10 


















Current smoker (yes/no) 


2.18 


1.28 


3.71 


<0.01 
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for macro- and microvascular complica- 
tions and noncardiovascular mortality. 
Table 1 shows the HRs, 95% CIs, and 
P values for these risk factors. Significant 
modifiable risk factors v^^ere HbAi^ and 
NHDL-C for CHD, HbAi^, SBP, and 
NHDL-C for stroke, BMI <18.5 kg/m^ 
and being a current smoker for noncar- 
diovascular mortality, HbAi^. and being a 
current smoker for overt nephropathy, 
and HbAic for retinopathy. Having an ex- 
ercise habit was associated with reduced 
risks of stroke and mortality, although 
with only borderline statistical signifi- 
cance. All of the risk factors that were re- 
tained through the variable selection 
procedure were incorporated into the 
JJ risk engine. The algorithm of the 
JJ risk engine is described in Supplemen- 
tary Data. 

The performance of the JJ risk engine 
was evaluated by several validation criteria. 
Tertile Cox regression showed that the 
5-year risks calculated by the JJ risk engine 
effectively classified populations at low and 
high risk for each complication. The HRs 
(95% CI) of the second and third tertiles 
compared with the first tertile were 2.09 
(1.07-4.09) and 5.22 (2.84-9.58) for 
CHD; 1.78 (0.96-3.30) and 3.32 (1.86- 
5.92) for stroke; 2.14 (1.09-4.18) and 

3.17 (1.65-6.09) for noncardiovascular 
mortality; 1.54 (0.55-4.34) and 10.59 
(4.56-24.59) for overt nephropathy; and 

1.18 (0.58-2.40) and 2.56 (1.37-4.81) 
for progression of retinopathy. 

Table 2 shows the predictive accuracy 
of the JJ risk engine regarding calibration 
and discrimination. The 0/P ratios for 
each complication, including noncardio- 
vascular mortality, ranged between 0.93 
and 1.08, and Hosmer-Lemeshow tests 
did not show any significant deviations 
between the observed and predicted 
events. In contrast, the UKPDS risk en- 
gine (5,6) overestimated CHD risk in 
Japanese patients (0/P ratios [Hosmer- 
Lemeshow P]: 0.30 [P < 0.01] for CHD 
and 0.72 [P = 0.54] for stroke) (Table 2). 
Discrimination according to C statistics 
was high for CHD, noncardiovascular 
mortality, and overt nephropathy (0.696- 
0.767) but was moderate for stroke and 
progression of retinopathy (0.636 and 
0.614). 

Table 3 compares risk classification 
by the 5-year risk of macrovascular dis- 
ease based on the JJ risk engine with that 
based on the UKPDS risk engine. By the 
UKPDS risk engine, more than half of pa- 
tients had a macrovascular risk of 10% 
or more (249 of the 376 cases and 697 



Table 2 — Predictive accuracy of the JJ risk engine in 1,748 patients 



Calibration Discrimination 
Mean predicted Observed 







5-year risk O/P ratio 


Pt 




95% CI 


CHD 


2.70% 


2.92% 


1.08 


0.14 


0.725 


0.656-0.793 


by tne UKr^ub 
risk ei|mm| 


■ (9.66%) 




(0.30) 


(<0.01) 


(0.695) 


(0.626-0.764) 


Stroke 


3.36% 


3.26% 


0.97 


0.12 


0.636 


0.564-0.708 


By the UKPDS 

risk engine 














Noncardiovascular 
mortality 


2.08% 


2.12% 


1.02 


0.12 


0.696 


0.613-0.778 


QyerL.n£DhroDathv 




2.40% 


1.04 


0.11 


0.767 


0.690-0.845 


Progression of 
retinopathy* 


10.96% 


10.20% 


0.93 


0.13 


0.614 


0.524-0.705 



*Patients without diabetes retinopathy at baseline were excluded. fThe Hosmer-Lemeshow test with eight 
degrees of freedom. P < 0.05 indicates significant deviation between predicted and observed events. 



of the 1,372 noncases), as expected by 
the tendency of overestimation The sen- 
sitivity and specificity of the UKPDS risk 
engine with a cutoff value of 10% risk 
were 66.2 and 49.2%, respectively. In con- 
trast, only 101 of the 376 cases (26.9%) 
who developed any of the events had a 
macrovascular risk of 10% or more based 
on the JJ risk engine, yielding sensitivity 
of 26.9% and specificity of 89.1%. 

Table 4 shows how the combination 
of 5-year risks of macro- and microvascu- 
lar complications based on the JJ risk en- 
gine classified low-risk and high-risk 
patients. If we combined macro- and 
microvascular risks, 73 of 376 cases 
(19.4%) and 187 of 1,372 noncases 
(13.6%) were newly classified as a high- 
risk population, and sensitivity increased 
up to 46.3% while specificity was main- 
tained at 75.4%. The net reclassification 



improvement (total of sensitivity and 
specificity in this case) was improved by 
5.7% (P = 0.02). 

To illustrate the use of the JJ risk 
engine, consider two Japanese men 60 
years of age with simple diabetic retinop- 
athy and without atrial fibrillation who 
do not have smoking and exercise habits. 
The clinical characteristics of both 
patients are HbAic = 9%, duration of di- 
abetes = 20 years, BMI = 23 kg/m^, 
NHDL-C = 3.88 mmol/L, and ACR = 
6.79 mg/mmol creatinine. The SBP of 
one patient is 120 mmHg. His leading 
risk is estimated to be the progression 
of retinopathy (5-year risk, 15.5%), and 
his macrovascular risks are moderate 
(9.2% for CHD and 9.6% for stroke). His 
5-year risks of noncardiovascular death 
and overt nephropathy are low (4.8 and 
3.7%, respectively). The other patient has 



Table 3 — Risk classification of the 1,748 patients according to 5-year risks of macrovascular 
disease based on the JJ risk engine and the UKPDS risk engine 







5-Year risk by the JJ risk engine* 




5-Year risk by the UKPDS risk engine* 


<5% 


5-10% 


10% or more 


Total 


Patients who developed events 


<5% 


37 


9.8% 


2 0.5% 


0 


0.0% 


39 


5-10% 


66 


17.6% 


19 5.1% 


3 


0.8% 


88 


10% or more 


37 


9.8% 


114 30.3% 


98 


26.1% 


249 


Total 


140 




135 


101 




376 




<5% 


245 


17.9% 


7 0.5% 


0 


0.0% 


252 




341 


24.9% 


78 5.7% 


4 


0.3% 


423 


10% or more 


202 


14.7% 


349 25.4% 


146 


10.6% 


697 


Total 


788 




434 


150 




1,372 



*Data are n and percent. Probability of any occurrence of CHD or stroke vrithin 5 years. 
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Table 4 — Risk classification of the 1,748 patients according to 5-year risks of macro- and 
microvascular diseases based on the JJ risk engine 







5-Year risk of macrovascular disease* 




5-Year risk of microvascular diseasef 


<5% 


5- 


-10% 


10% 


or more 


Total 


Patients who developed events 


<5% 


79 


21.0% 


48 


12.8% 


19 


5.1% 


146 


5-10% 


40 


10.6% 


35 


9.3% 


20 


5.3% 


95 


10% or more 


21 


5.6% 


52 


13.8% 


62 


16.5% 


135 


Total 


140 




135 




101 




376 




<5% 


601 


43.8% 


215 


15.7% 


40 


2.9% 


865 




■lit 


.t;4% 


104 


7.6% 


34 


2.5% 


240 


10% or more 


72 


5.2% 


115 


8.4% 


76 


5.5% 


267 


Total 


759 




434 




150 




1,372 



*Data are n and percent. Probability of any occurrence of CHD or stroke within 5 years. tProbability of any oc- 
currence of overt nephropatliy defined by persistent proteinuria or progression of retinopathy within 5 years. 



an SBP of 180 mmHg. His leading risks are 
macrovascular diseases (16.1% for CHD 
and 17.6% for stroke), and his mi- 
crovascular risks are moderate (7.8% for 
nephropathy and 13.6% for retinopathy). 
The risk of noncardiovascular mortality is 
estimated to be 4.0%. 

CONCLUSIONS— In this study, we 
developed a novel risk engine that inte- 
grates modifiable lifestyle and clinical 
risk factors, including HbAic, BMI, SBP, 
NHDL-C, current smoking, and LTPA 
into the risks of a first occurrence of 
macro- and microvascular complications. 
We confirmed that the risk engine per- 
formed reasonably well and that com- 
bining macro- and microvascular risks 
improved the classification of low-risk 
and high-risk patients by a net reclassifi- 
cation improvement of 5.7%. In contrast, 
the UKPDS risk engine overestimated 
CHD risk, and this tendency is consistent 
with a previous report in Asian patients 
(18). A web application for the JJ risk en- 
gine, which works in both Windows and 
Macintosh environments, is available at 
http;//www.biostatistics.jp/prediction/jjre. 

With the advent of modem dierapeutics, 
especially hypoglycemic and antihyperten- 
sive agents, the early identification of high- 
risk patients is an appealing strategy (35). A 
novelty of the JJ risk engine is that it allows 
risk classification based on the risk not 
only of CVD but also of renal and eye dis- 
eases. Although the prevalence of micro- or 
macroalbuminuria in Asian hypertensive 
diabetes is alarmingly high (36), most of 
the progression to overt nephropathy 
occurs in a small fraction of patients 
with elevated HbAi^ and SBP values 



and a smoking habit (12). In this study, 
patients in the fourth quartile of the calcu- 
lated risk developed overt nephropathy 
at a rate 10 times greater than those in 
the first quartile. Most risk engines are 
specific to CVD; however, greater emphasis 
on the risk of microvascular diseases 
should be placed when assessing risk 
among diabetic patients given that dia- 
betic nephropathy and retinopathy are 
major causes of ESRD and blindness, re- 
spectively. Combining macro- and mi- 
crovascular risks resulted in the net 
reclassification improvement of 5.7% 
(P = 0.02) and a sensitivity and specificity 
of 46.3 and 75.4%, respectively; only 
16.5% of cases were classified as the 
high-risk population for macro- and mi- 
crovascular diseases and only 43.8% of 
noncases were in the low-risk popula- 
tion (Table 4). Thus, the discriminatory 
power of the JJ risk engine was only 
moderate, despite the statistically signifi- 
cant improvement in prediction, and ex- 
ploring novel risk factors would be of 
particular importance for more accurate 
risk classification. 

The JJ risk engine shares features 
similar to those with previously devel- 
oped risk engines. The predictors of CHD 
are the same as in the UKPDS risk engine 
(5) except for the inclusion of NHDL-C 
instead of the total cholesterol-to-HDL 
cholesterol ratio. Donnan et al. (7) added 
diabetes duration, treated hypertension, 
height, and two interaction terms into 
their model, and the risk equation of the 
HKDR includes diabetes duration, esti- 
mated glomerular filtration rate, and 
ACR additionally but does not use HbAi^ 
(18). A recent cohort study in Japan also 



suggested that the progression of the albu- 
minuria stage is a risk factor of CVD (37). 
In contrast, log ACR was not associated 
with CHD or stroke in our study. This dis- 
cordant observation would be attributable 
to the exclusion of low microalbuminuria 
in our study. The elevation of ACR 
within a range of normoalbuminuria may 
not lead to an increase in the risk of CVD. 
We also found that the UKPDS risk engine 
overestimated CHD risk (Table 2) and the 
C statistic of the JJ risk engine (0.725) was 
slightly higher than that of the risk equa- 
tion of the HKDR (0.704) (18), indicating 
that the JJ risk engine may outperform the 
previously developed risk engines for the 
prediction of CHD. For the prediction of 
stroke, we did not identify smoking status 
and years after diagnosis as predictors, 
which are included in the UKPDS risk 
engine (6). The risk equation from the 
Swedish National Diabetes Register incor- 
porates the use of antihypertensive drugs 
and lipid-lowering drugs as predictors (9). 
However, medical therapies are not con- 
sidered in the current analysis, since the 
effects of medications on vascular compli- 
cations were likely to be confounded by 
other clinical factors. In contrast to CHD, 
the C statistic of the JJ risk engine (0.636) 
was similar to the UKPDS risk engine 
(0.638) and lower than the risk equation 
of the HKDR (0.749) (17). With regard to 
lifestyle factors, we identified LTPA as a 
risk factor for stroke and noncardiovascu- 
lar mortality, although the statistical sig- 
nificance was borderline. On the other 
hand, BMI, which has been recognized as 
one of the most important risk factors in 
the deterioration of type 2 diabetes, was 
not associated with CVD. We previously 
reported that the BMI of Japanese patients 
is much lower than that of white patients, 
although in those reports, other patient 
characteristics were similar in terms of 
age, HbAic, and daily energy intake 
(10,11). Our findings run contrary to the 
results of studies of white patients, but 
data on diet in diabetic patients are sparse, 
particularly in Asia. In this study, the con- 
tribution of lifestyle factors to the risk as- 
sessment appears to be limited, and the 
associations between lifestyle and diabe- 
tes complications are worthy of further 
research. 

One important feature of this study 
is that we analyzed pooled data from two 
nationwide clinical trials in Japan. The 
end points were defined similarly in both 
trials and follow-up was performed by 
diabetes specialists, ensuring data of 
relatively high quality. Patients generally 
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had fair or good glycemic, weight, blood 
pressure, and lipid control. The major 
difference between the two trials was 
eligible age, i.e., age between 40 and 70 
years in the JDCS and age between 65 and 
85 years in the J-EDIT. Prior to pooling the 
datasets, we compared important clinical 
factors between patients in the two trials 
and found no notable differences except 
for age; therefore, pooling of the datasets 
was considered to be valid. Consequently, 
the study population in the present anal- 
ysis included subjects spanning several 
decades, i.e., those from 40 to 84 years. 
This can be expected to enhance the gener- 
alizability of the algorithm. 

Statistical modeling can be much more 
complex if we handle multiple events 
simultaneously. To the best of our knowl- 
edge, this is the first study that applies a 
multistate model to the construction of a 
risk engine. It is notable that these events 
are not inherently independent and the 
JJ risk engine calculates each probability 
of the first occurrence for five events. 
Thus, if the risk of an event (e.g., overt 
nephropathy) was increased by a risk 
factor (e.g., log ACR), the probability of 
the first occurrence of other events (e.g., 
stroke) can decrease theoretically even if 
there are no direct associations with the 
risk factor. 

Several limitations warrant mention. 
First, transportability of prognostic infor- 
mation is critical, but in this study we 
evaluated only the internal validity. Thus, 
external validation is required in other 
populations. Second, updating the algo- 
rithm by long-term follow-up data or 
pooled analysis with other studies in Asia 
is desirable given that the size of our 
cohort is relatively small and the observed 
events of CVD and overt nephropathy in 
this population were relatively few. Third, 
we included angina pectoris and transient 
ischemic attack as components of the 
cardiovascular events, although they are 
soft end points. Consequently, the JJ risk 
engine would provide macrovascular risks 
higher than those by other risk engines 
based on only hard cardiovascular events. 
Fourth, data on peripheral arterial disease 
and hemoglobin levels were not available. 
These factors were included as inputs into 
the HKDR all-cause mortality risk score 
(19), and peripheral arterial disease is a 
clinically relevant cardiovascular out- 
come. Fifth, the use of aspirin, which 
might increase the risk of hemorrhagic 
stroke, was not investigated. Finally, we 
defined overt nephropathy as the presence 
of persistent proteinuria, since an elevated 



urinary albumin excretion due to nondia- 
betic renal lesions or conditions is not rare. 

In conclusion, the risk engine allowed 
accurate and comprehensive risk assess- 
ment of macro- and microvascular com- 
plications, although external vaUdation is 
required in other populations. The calcu- 
lated absolute risks of vascular complica- 
tions can be used in risk classification for 
individual patients, health economic sim- 
ulations, and estimation of the burden of 
the disease. 
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